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Abstract. Motivated by applications in wireless communications, this paper develops semidef- 
inite programming (SDP) relaxation techniques for some mixed binary quadratically constrained 
quadratic programs (MBQCQP) and analyzes their approximation performance. We consider both a 
minimization and a maximization model of this problem. For the minimization model, the objective 
is to find a minimum norm vector in Af-dimensional real or complex Euclidean space, such that Q 
out of M concave quadratic constraints are satisfied, where Q is an integer satisfying 1 < Q < M . 
By employing a special randomized rounding procedure, we show that the ratio between the norm 
of the optimal solution of the minimization model and its SDP relaxation is upper bounded by 
0{Q^{M — Q + 1)) in the real case and by 0(M{M — Q + 1)) in the complex case. For the maxi- 
mization model, the goal is to find a maximum norm vector subject to a set of quadratic constraints 
and a cardinality constraint with both binary and continuous variables. We show that in this case 
the approximation ratio is bounded from below by 0(l/ln(M)) for both the real and the complex 
cases. Moreover, this ratio is tight up to a constant factor. 

Key words, nonconvex quadratic constrained quadratic programming, semidefinite program- 
ming relaxation, approximation bound, NP-hard 
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1. Introduction. Motivated by applications in wireless communications, we 
study in this paper two classes of mixed binary nonconvex quadratically constrained 
quadratic programming (MBQCQP) problems, where the objective functions are 
quadratic in the continuous variables and the constraints contain continuous and 
binary variables. Although these two classes of optimization problems are nonconvex, 
they are amenable to semidefinite programming (SDP) relaxation. The focus of our 
study is on the approximation bounds of the SDP relaxation for both problems. 

The minimization model. Consider the following MBQCQP problem: 

min ||w|p 

s.t. w^H,w >Pi, ieM (1.1) 

ieM 

p^e{0,l}, ieM 

where F is either the field of real numbers M or the field of complex numbers C, 
= {1, • • • ,M}, (3 = (/3i,- • • ,I3mV, (i = 1, • • • ,M) are TV X TV real symmetric 
or complex Hermitian positive semidefinite matrices, |j • |j denotes the Euclidean norm 
in F^, AI and Q are given integers satisfying 1 < Q < M. Throughout, we use the 
superscript H to denote the complex Hermitian transpose. Notice that the problem 
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(jl.ip can be easily solved either when N — 1 or M — 1, by solving a maximum 
eigenvalue problem. Hence, we shall assume that N > 2 and Af > 2 in the rest of the 
paper. We note that problem is in general NP-hard, due to the fact that one of 
its special cases with Q = AI is NP-hard; see [161 Section 2]. 

Our interest in problem (11.11) is motivated by its application in telecommunica- 
tions. For example, consider a cellular network where M users, each equipped with a 
single receive antenna, are served by a base station (BS) with N transmit antennas. 
Assume that a linear transmit beam w e C^^^ is used by the BS to transmit a 
common message to the users. Let hi G C^^^ denote the complex channel coefhcient 
between the BS and user i, and let Ui denote the thermal noise power at the receiver 
of user i. Using these notations, the signal to noise ratio (SNR) at the receiver of each 

user i £ A4 can be expressed as SNR^ = ^'^ ^^^^ ■ Such received SNR level measures 
the quality of the received signal, and is directly related to the effective rate of the 
communication. In order to successfully decode the transmitted message, typically a 
quality of service (QoS) requirement in the form of ^'^'^ > ji is imposed by each 
user i £ A4, where 7^ is a predetermined QoS threshold. Let us define hi = ^/^^ 
as user i's normalized channel. When assuming that all M users are served by the 
BS, the classical physical layer multicast problem can be formulated to the one that 
minimizes the transmit power of the BS while maintaining the QoS requirements [24] : 

min ||w|p (1.2) 

W 

s.t. Iw^hjp > 1, i£M. 

This problem is an NP-hard quadratically constrained quadratic programming (QCQP) 
problem; see e.g., [TB] . 

However, when the number of users in the network is large, it is usually not 
possible to simultaneously guarantee the QoS for all the users. In this case, user 
admission control should be implemented to select a subset of users to serve. For 
instance, we can select to serve a subset of Q users (with Q a given number and 
Q < M). This results in the following joint physical layer multicast and admission 
control problem: 

min ||w|p (1-3) 
weC",/3 

s.t. \w"h^\^ >I3„ i£M 

Y.f3r>Q. Ae{0,l}, i£M. 

In the above formulation, the binary variables {Pi}ii£M indicate whether a particular 
user i should be served — when /3i = 0, there is no guarantee that its QoS constraint will 
be satisfied. Problem (|1.3|) is closely related to a different form of the joint admission 
control and beamforming problem, in which the goal is to pick the maximum number 
of users to serve, subject to their respective QoS constraints plus the BS's power 
constraint [18l [191 111]- Obviously, (|1.3I) is a special case of the MBQCQP problem 
([LT|) if we set Hi = h,hf , for all i £ M. 

An effective approach to approximately solve the NP-hard problem ()1.2p is to use 
the semidefinite programming relaxation technique [17) together with a randomized 
rounding step. The idea is to first reformulate the problem by introducing a rank-1 
matrix X = ww^. After dropping the nonconvex rank-1 constraint on X, the relaxed 
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problem becomes an SDP, whose optimal solution X can be efficiently computed. A 
randomization procedure then follows which converts X to a feasible solution of (|1.2p . 
It has been shown in |16| that such SDP relaxation scheme generates high-quality solu- 
tions, whose worst case performance bound can be explicitly characterized. However, 
for the more general problem (jl.ip with both binary and continuous variables, there is 
no known performance guarantees for the performance of SDP relaxation techniques. 

The maximization model. Another interesting case of the MBQCQP problem 
takes the maximization form as follows: 

max ||w|p 
weF",/3 

s.t. w^H,w < A • e + (1 - /30 • 1, ieM (1.4) 
= ft e {0,1}, leM 

where < e < 1 and 1 < Q < M. The above MBQCQP problem pTi)) arises naturally 
in the interference suppression problem in radar or wireless communication. Here, the 
interference suppression is captured by the constraints (11.41) , in which the constants e 
and 1 represent two distinctive suppression levels. The optimization problem becomes 
the one that maximizes the gain of the antenna array while suppressive undesirable 
interferences. Notice that problem ()1.4|) can be easily solved when iV = 1 or M = 1. 
As a result we assume N > 2 and M > 2 in the rest of the paper. 

Notice that if e = 1, then problem (|1.4I) reduces to a continuous homogeneous 
QCQP problem for which the theoretical ratio between its optimal solution and the 
SDP relaxation has been shown to be bounded below by 0(l/ln(M)) pi [TCI 
However, for the general case when < e < 1, no approximation bounds for SDP 
relaxation are known. 

Our Contributions. In Section 2 and 3, we reformulate problems (12.11) and 
(|1.4|) as certain homogeneous QCQP problems. We then develop an SDP relaxation 
for these homogeneous problems and devise a novel randomization procedure to gen- 
erate approximate solutions for the original NP-hard MBQCQP problems p.ip and 
(|1.4p . To analyze the quality of such approximate solutions, we derive upper or lower 
bounds of the approximation ratios between the optimal solution of the two MBQCQP 
problems and their corresponding SDP relaxations. Our main results are as follows: 
i) For problem (12. ip . the approximation ratio is upper bounded by 0{Q^{M — Q + 1)) 
for the real case and by 0{M{M — Q -I- 1)) for the complex case; ii) For problem 
(|1.4p . the ratio can be arbitrarily bad when e = 0; otherwise it is bounded from below 
by C'(l/ln(Af)) for both the real and the complex cases. To the best of knowledge, 
our analysis is the first attempt to rigorously characterize the approximation bounds 
for MBQCQP-type problems and their SDP relaxations. 

Related Literature. There is a sizeable literature on the quality bounds of 
SDP relaxation for solving nonconvex QCQP problems, including the works of Luo 
et al. [16], Nemirovski et al. [20], A. Ben-tal et al. |2]. Moreover, for the max-cut 
problem, which is a special QCQP problem with only discrete variables, Goemans and 
Williamson [9j showed that the ratio of the optimal value of SDP relaxation over that 
of the original problem is bounded below by 0.87856 . . .. For closely related results, 
see [281 18]. In the absence of the discrete constraints. Beck and Teboulle [1 considered 
the continuous nonconvex problem of minimizing the ratio of two nonconvex quadratic 
functions over a possibly degenerate ellipsoid, and showed that the SDP relaxation 
can return exact solutions under a certain condition. He et al. [IV showed that the 
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ratio between the optimal value of a homogeneous continuous QCQP problem and 
its the SDP relaxation is upper bounded by ©(M^) (resp. 0{M)) in the real (resp. 
complex) case, if all but one of the quadratic constraints are convex. However, for the 
mixed binary and continuous type QCQP problems, there is no known approximation 
bounds for SDP relaxations. 

Another popular method to approximately solve the MBQCQP problem is to relax 
the 0-1 variables to continuous variables in the interval [0,1]. However, this approach is 
effective only when the resulting continuous relaxation problem is itself convex. Under 
this assumption, a variety of algorithms have been proposed, including branch and 
bound [26, , outer approximation 7 , the extended cutting-plane method 27 , and so 
on. Unfortunately, for the two optimization models (|2.1I) and (|1.4p considered in this 
paper, their continuous relaxations are nonconvex, which makes the aforementioned 
strategies ineffective. In a recent paper, Billionnet et al. [4 proposed a method 
called Quadratic Convex Reformulation (QCR) to convert nonconvex 0-1 QP problems 
to convex ones by using SDP, rather than merely relax them. In their follow-up 
paper, Billionnet et al. [3] extended the QCR framework from 0-1 QP to mixed- 
integer quadratic programming (MIQP). However, their approach works only under 
certain restrictive assumptions, e.g., the objective and the constraints corresponding 
to the continuous variables are convex, which unfortunately do not hold in our current 
context. Some alternative approaches to MBQCQP have recently appeared in [Sj [22l 
[53] . More detailed reviews of recent progress on related problems can be found in the 
excellent surveys [51 [TH [T3] . 

Notations. For a symmetric matrix X, X )^ signifies that X is positive semi- 
definite. We use Tr [X] and X[z, j] to denote the trace and the (i, j)th element of a 
matrix X, respectively. For a vector x, we use ||x|| to denote its Euclidean norm, and 
use x[i] to denote its ith element. For a real vector y, use y[m] to denote its mth 
largest elements. For a complex scalar x, its complex conjugate is denoted by x. The 
notation I„ is used to denote a n x n identity matrix. Given a set A, \A\ denotes the 
number of elements in set A. Also, we use M^^^^ and C^^^^ to denote the set of 
real and complex N x Al matrices, and use and to denote the set oi N x N 
hermitian and hermitian positive semi-definite matrices, respectively. We use E(-) to 
denote the expectation operator. Let e denote the «th unit vector whose 

entries are all zero except ei[i] — 1, and let e e R(*^+i)'^i denote the all 1 vector. 
Finally, we use the superscript H and T to denote the complex Hermitian transpose 
and transpose of a matrix or a vector respectively. 

2. Approximation bounds for the minimization model. 

2.1. Reformulation and SDP relaxation. In this section we consider the 
minimization problem (jl.ip and its SDP relaxation. We first notice that, by mono- 
tonicity, we can assume without loss of generality that the inequality constraint 
^ieM A — *3 (|l.ip holds with equality, resulting in the following equivalent for- 
mulation: 



mm 

weF",/3 



w 



2 



S.t. 



w^H.v^f > /3j, ie M 
Y,P^^Q, A e {0, l},ieM 



(2.1) 
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By performing a simple transformation — 2(3^ — 1, for all i G A^, we convert the 
range of the binary variables to {—1,1}. We further introduce an auxiliary binary 
variable ^ G { — 1, 1}, and transform the problem (|2.1I) equivalently to 



mm 

wgf",(q:,. 



s.t. 



M 



\,a~ = \, i e M. 

To write the above problem into a more compact form, we make the following defini- 
tions; 



/-I A 1 T 







1 



1 




H 



^ ]p(A/+l + W)x(M+ln) g A 



b(A/+1)x(M+1) 



I e 
M 




D(M+l+Ar)x(Af+l + Af) 



X« ^ WA^. x(2) x^ [x(1)^,x' 



(1)T ^(2)TiT 



With these definitions, the problem can be written as the following homogeneous 
QCQP problem: 

r(2)||2 



v-^^ ^ mm 



s.t. 



ix^ 



(PI) 



x^A,x > 1, ieM 
x^Bx = 4g, 
(xH)2 = 1, i e X. 

Let x be a global optimal solution of problem (IP1[) . and Ugp" be the optimal 
objective value. 

To obtain an approximate solution for the nonconvex quadratic problem ()P1[) , let 
us consider its SDP relaxation. However, caution should be exercised when relaxing 
(IP1[) — unlike the conventional QCQP problem studied in, e.g., [T71IIS], the noncon- 
vexity of our current problem arises from hoth continuous and binary variables. To 
proceed, let us introduce a new matrix variable X ^ xx^ , which admits the following 
block structure 

X(i) X(3) 



X = 



(X(3))^ X(2) 



(M+l+JV) X (M+l+W) 
+ 



(2.2) 



where X^i) ^ x(i)(x(i))^, X^^) ^ x(2)(x(2))ff, X(3) ^ x(i) (x(2))^^, and the ranks 
of matrices X'^^\ X'^^) ^^d X are all 1. Actually, the discrete constraint X(^)[z,j] e 
{— 1, 1} can be implied by these rank-1 constraints. By dropping all the rank-1 con- 
straints, we obtain the following SDP relaxation problem for (|Pip : 

min Tr[X(2)] 

s.t. Tr[A,X] > 1, iaM (SDPl) 
Tr[BX] = 4Q, 

XhO,x(i)[i,i] = l,ie 
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Let X denote the optimal solution for this problem, and let t'g^p denote its optimal 
objective value. Obviously, we have t'g^p < i^qp"- Moreover, from the block diagonal 
structure of the matrices C;, A^, B, it is easy to see that X*^^^ is a real symmetric PSD 
matrix, and that without loss of generality we can assume 

In the following, we aim to generate a feasible solution x for (jPip from X, and 
evaluate the quality of such solution. In particular, we would like to find a constant 
/i > 1 such that 



|x(2)||2 < 



M^'SDP- 



By using the fact that such generated solution is feasible for problem (|2.ip . we have 
Vqp < II^^^'IP; which further implies that the same /x is an upper bound of the SDP 
relaxation performance, i.e., 

«Q^? < (2.3) 
The constant fi will be referred to as the approximation ratio. 

2.2. A new randomization procedure. Upon obtaining the optimal solution 
X of problem (jSDPip . we propose to use the randomization procedure outlined in 
Table [TT] to obtain a feasible solution for problem (|Pip . In essence, this procedure 
consists of the following two parts. 

Part 1) This includes Steps SI and S2 in Table 12.11 in which we generate the 
binary variable x*-^' from X. It is easy to verify that x'^^ generated in this way satisfies 
the constraints x-^Bx = AQ and (x[i])^ = 1 (i e M). 

Part 2) This includes Steps S3 and S4 in Table 12. 1[ where we generate the 
continuous variable x*-^'. Together with x*-^' generated in the previous stage, x must 
also satisfy the set of conditions x-^A^x > 1, for all i G A4. This fact can be argued 
as follows. For all i E I, wc have 

x^A.x = (x(i))^C,x(i) + (x(2))ffH,x(2) 

= (x(i))^C.x«+i2(^(2))ffH.^(2) 

> (x(i))^Qx(i) + i (C(^')^H,4(2) 

= 1, (2.4) 
where the last step is due to C^, ^ and the definition of t. For all i ^ I, we have 
x«A,x = x(i'^C,x(i) + (x(2))^H,x(2) = 1 + (x(2))^H,x(2) > 1, (2.5) 

where the second equality follows from the definition of and x*^^-', while the last 
step is due to ^ 0. 

In summary, by using the randomization procedure in Table 12. 1[ we obtain a 
feasible solution to problem (jPip . 



2.3. Analysis of the approximation ratio. In the case when Q = M, the 
problem (jPip reduces to the following continuous QCQP 



s.t. w^HiW > 1, ieM, 
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Table 2.1 

The Randomization Procedure for the Minimization Model 



SO: Solve the SDP relaxation problem (|SDP1[) to get X which has 
the following block structure: 

^ - [ X(2) 

with X(i) e §f and X(2) g S^><^. 
SI: Let y ^ {X^^^ [i,M + l]: ieM}. 

Define an index set X = {j : y[i] > y[Q], « G A^}. 
S2: Set x^^) [M + f ] = 1 and x^^) [i] = 1 for aU i e I; 

Set x(i) H = -1 for aU i e 7W \ X. 
S3: Generate a random vector ^^^^ G F" from the normal 

distribution 7Vf(0, X'^)); 



S4: Let xf^) = ^j^j^ ^ ^ ^m&x,ei [j^^^^Jf^] 
S5: Letx = (x(i)^,x(2)^)^. 



for which the SDP relaxation is known to provide a 



27M^ 



approximation in the real 



case and a 8M approximation in the complex case [16]. In the sequel, we will only 
consider the case when Q < M — 1. 

Before presenting our main result, we first need a technical lemma on the lower 
bounds of the values of the elements in the set {'K.^^'>[i,M + 1] | z G Ai}. 

Lemma 2.1. For Q < M — 1, given a constant 5 and define the set 

n{S) ^ {i : X(i)[i,Af + 1] > -1 + S,i = !,■■■ ,M}. 

Then we have \TZ{S)\ > Q for all S that satisfies < S < jjz^^- 

Proof. We prove this lemma by contradiction. Suppose that |7?.((5)| < Q — 1, or 
equivalently \M\n{S)\ > M - Q + 1. The feasibility condition Tr[BX] = 4Q implies 
that 



M 



^X(i)[2,Af + l] = 2g 



M. 



(2.6) 



1=1 



On the other hand, since X'^^^[i,i] = 1 for all i = 1, • • • , Af + 1, we know that 
X(i)[i,7\/ + 1] < 1. This, plus the fact that X.^^'>[i, M + 1] < -1 + S for all i ^ R{S), 
implies that 



M 



^X(i)[i,M+l] < {M -Q + l){-l + 5) + Q-l 



= -M + Q-l + S{M-Q + l) + Q-l 
< -M + Q - 1 + 2 + Q - I = 2Q - M, 



which contradicts (|2.6p . □ 
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This result leads to the following characterization of the set X generated by the 
proposed algorithm. 

Lemma 2.2. After Step S2 in the randomization procedure listed in Table [KT[ 
for all iel, we have X(i)[i, A/ + !]>-!+ m-q+i ■ 

Proof. Set S — ^gz^^rj- Lemma [2.11 implies that there exists at least Q elements 
in y, defined in Step SI in Tab el \TT[ that are greater than —1 + jj-^ffi- Since I 
contains the Q largest elements of y, the claim follows immediately. □ 

We are now ready to present a key result of this section, which essentially bounds 
the probability that both the normalization constant and the objective value of the 
approximate solution are small. 

Lemma 2.3. Suppose Q < M — 1. Let x be generated by the randomization 
procedure listed in Table \2J\ Then with probability 1, x is well defined and feasible 
for (|P1|) . Moreover, for any a > and n > 0, 



< /iTr[X 



(2) 



>1-Q.a{a)--, (2.7) 



with 



M-Q + 1 2(r - 1) M-Q + 1 I 
cr(a) = max < \ , — • > , when It = K, (2-8) 



and 



aia) = max (1 . E^Q±1, i6(. - l)^ . i^i^Q±ll\ , ^ = c, (2.9) 

where r := niin{rank(X''^'), rank(Hi), i G A^}. 

Proof Since X ^ is feasible for (|SDP1|) . it follows that Tr[A,X] > 1 for 
all i = I,-- - ,Af. On the other hand, the density of (^^'■^■') Hi^^^-* is continuous, 

thus the probability (^C'^''^ Hi^^^-* = is zero which implies that t in Step S4 of 
the randomization procedure is well defined. The feasibility of x generated by the 
randomization algorithm is shown in Section 2.3. 

For any a > and /i > 0, we have 

Prob(t2 <a, ||x(2)||2 <^Tr[X(2)]) 

>Prob(t2 <a, 11^(2) II 2 < /^Tr[X(2)]) 
/ 

=Prob 



^ —<a,yiel: ||^(')||2 < ^Tr[X(2)] I . (2.10) 



(^(2)) H.^(^) 
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Since TrfA^X] > 1, we have 



Tr 



Tr A,X - Tr 



c.x(i) 



> 1 - Tr 



C,:X(i) 



>l--(4-2 



M - 



M-Q + 1 

Vi el, 



(2.11) 



where the second inequahty follows from the definition of C;, the fact that the diag- 
onal entries of X^^^ equal 1 as well as Lemma 12.21 From the way that the random 

sample ^^^^ is generated, we have E (^'^H^'^')^) = X'^' and E ((|(^))^H,|^^^) = 

Tr[H,X(2)]. By combining (I^HI)) and (piTj) . we have 

Prob(t2 11^(2) ||2 <^Tr[X(2)] 

^(2)^i^w.tf(2) ^ M~Q + 1 



>Prob >rli,e > > 



a 



Tr[H,X(2)],V i e I; H^^^^f < ^Tr[X(2)] 



>l-^Prob((|(2))ffH,^(2) < 
iei 
— Prob 



M-Q + 1 



a 



Tr[H,X(2); 



?(2)ii2 ^ t: 



> :^Tr[X(2)] 



a 



> 1 



a 



a{a) 



(2.12) 



where the last inequality (|2.12p is from the [TF, Lemmas 1 and 3] as well as the Markov 
inequality; a{a) is defined as in (|2.8I) and (12.91) . □ 

Now we can use Lemma 12.31 to derive a fundamental relationship between the 
optimal objective value of the problem (jPip and the optimal objective value (ISDPip . 
We first consider the real case. 



Theorem 2.4. Let¥ = R and Q <M-l. If Q < 2v^(2yM+T- i) ^ ^^^^ 



3(71-2) 



< 



18(2VAf + 1 - 1)Q(M - Q + 1)_ 
0F(vr - 2) 



^SDP- 



Otherwise, we have 



< 



27Q2(M-Q + 1) 



(2.13) 



(2.14) 



Proof. By applying a suitable rank reduction procedure if necessary, we can 
assume that the rank f of optimal SDP solution X satisfies r(r + l)/2 < 2(M + 1); 
cf., [21] [25]. Moreover, this low rank matrix can be constructed in polynomial time; 



see [13]. Thus, r in (|2.12p satisfies r < r < 2y/ M + 1. We apply the randomization 
procedure listed in Table [2Tl to X. From (|2.7p . we have 



(2.15) 



Proh[t^<a, ||x(2)||2 <;,Tr[X(2); 
a 



> 1 



(7(a) , 

A* 
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where 

/ / M-Q + 1 2(2VmTT-1) M-Q + i \ 

<j{a)=maxi\ , S. 2.16) 

V ce TT — Z a \ 

We consider two cases a s foll ows. 

Case I: Q < ^^^3(^^^2)^~^'' • ^^^^ case, we choose 

6(27M+T-1)Q(M-Q + 1) 
a = , /x = 3q;. (2.17) 



From Q < '^^l^-'^ we have 



6(2VIT + T - l)Q{M - Q + 1) 4(Af - Q + 1)(2VM + 1 - 1)^ 
a — — < 



V^(vr - 2) - (vr - 2) 

and thus, 



M-Q + 1 ^ 2(2 VAf +1-1) M-Q + 1 
a ~ TT — 2 a 

Then, we have 



2(2VM+T-1) M-Q + 1 
= a - 3Q ' 

where the last step follows from the definition of a. From (|2.15p and (I2.17p . we have 
that 

Prob (f < a, ||x(2)||2 < /iTr[X(2)]) > l _ _ 1. (2.18) 

We see from the above inequality that there is a positive probability (independent of 
problem size) of at least 

xAr 1 

1 - = 0.0758... 

3 3 

that 



^ ^ 6(2VmTT - 1)Q(M - Q + 1) 
max < > < 



and 

min 11^(2) ||2 < 3Tr[X(2)]. 

Let ^ be any vector satisfying these two conditions. Then x is feasible for (|P1[) . so 
that 



v^^ < ||x(2)||2 = .„iax( i 



3 + 1) 

18(2 VMTT - 1)Q(M - Q + 1) 



(2) 



^ 6(2VmTT-1)Q(M-Q + 1) 3^rx(2)i 



V^{tt - 2) 



vsBP, (2.19) 
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where the last equality uses Tr[X'^^)] — Wg^p- 



Case II: Q > 2v^(^v^^^+i i) _ jjj ^jjjg case, we choose 



3(7r-2) 



9Q^{M-Q + 1) 

, ^ = 3a. (2.20) 



It can be easily verified that 

4(M-Q + l)(2VAf + 1- 1)2 



a > 



and thus 



Moreover, 



M -Q + 1 ^ 2(2 VM +1-1) M-Q + 1 
a ~ TT — 2 a 



lM-Q + 1 ^ 

"*"' = ^' — -c — = w 

'2'7(~)^ ( ]\,f (7) I 1) 

The rest of the proof is similar as those given in Case I with /i — — ^ ^ ^ ' . □ 
Next we consider the complex case. 
Theorem 2.5. LetW = C and Q < M - I. We have 



y^^," < 14(2Vim - ifiM -Q + l)f^ii"p. (2.21) 



Proof. Following the similar steps in the proof of Theorem 12.41 in this case we 
have 



Prob(t2 < «^ ||x(2)||2 <^Tr[X(2)] 



> l-Q-a-(a)--, (2.22) 

where 

,ia) . max (i . ' ^ + \ 16(2VmTT - if ^-^i^^X . (2.23) 
We choose 

a = 12(2VM + 1 - l f(M - Q + 1), M = (2-24) 

6 

We can easily verify that 

^ ^^^^^ = 16(2VMTT - 1)^ . (^^1^^, 



and 



a(a) — ^ < < -. (2.25) 

' 9(2V^^7TT- 1)2 - 9(2^/MTT- 1)2 - 9 ^ ^ 
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By (p:^ and ([123, we have that 

Prob(t2<a, ||x(2)||2<^Tr[X(2)] 



>l-i-^. 
- 9 7 



(2.26) 



We see from the above inequahty that there is a positive probabihty (independent of 
problem size) of at least 

1 6 

1-9-7 = 0-0317. .. 



that 



and 



max I ^ I < 12(2%/M + 1 - l f{M -Q + 1), 



min|||(2)|P<iTr[X(2)]. 


Let ^ be any vector satisfying these two conditions. Then x is feasible for (|P1[) . so 
that 



.Sl^><||x(^)|P = |||(^)|P 



1 



II -max 


H 


^(2)) 




lf{M- 


Q 


+ 1) 


6 ^ 


lf{M- 


Q 


+ 1) 


"SDP) 


min ri 
^SDP- '-' 









(2.27) 



We summarize the approximation bounds for the considered minimization model 
PT]) in Tabic 2.2. 

Table 2.2 

The Approximation Ratio for the Minimization Model 





F = M 


F = C 


Q = M 


(see m) 


8M (see [16]) 


Q <M -1 


27Q^(M-Q+1) 


14(2VM + 1 - 1)2(M -Q + 1) 



3. Approximation bounds for the maximization model. 
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3.1. Reformulation. Similar to the minimization model considered in Sec- 
tion 2, let us define = 2/3j — 1, for alH = 1, • • • , M, and introduce an additional 
binary variable £ G {— 1, 1}. Then problem (|1.4p can be equivalently transformed to 



max 



1 

s.t. w^H.w + -{ai + {l- t)lf < 1 + J, i^M 



(3.1) 



e = a\ = \, M. 



This equivalence can be verified by checking the two cases: whether ai and £ have the 
same or opposite sign. Let us define the following matrices 



1 - e 



1 - e 



4 ' ' 4 
C, 
H 



-e,e 



(M+l)x(M+l) 



^ £.(A/+l + 7V)x(M+l+Af) 

Using these definitions, the problem can be equivalently written as 



^QP 



r(2)||2 



S.t. x^AiX < 1 + — , i e 



(P2) 



x^Bx = 4Q 
x[i]^ = 1, ie M, 



where B and x are the same as defined in (jPl[) . Define the global optimal solution 
for problem (jP2[) as x, and its objective value as Vqp^. The SDP relaxation for (jP2p 
can be expressed as: 



wgJfP ^ max Tr[X(2)] 



s.t. Tr 



A„X 



< 1 



-, i e M 



Tr [BX] = 4Q 

X^O, X[i,i] = 1, i = 1, • • • , + 1 



(SDP2) 



where X has the same block structure as in (|2.2p . Let X denote the optimal solution 
for this problem, and denote its optimal objective value. By the diagonal struc- 
ture of Ai and for all i, we can assume without loss of generality that X^"^) = 0. 
Obviously, we have Vg'^p > Vqp^. 

3.2. The SDP relaxation and its approximation ratio. In this section, we 
consider using SDP relaxation to approximately solve the NP-hard problem (jP2[) . In 
particular, we would like to find a finite constant < /i < 1 such that Wqp'' > A'^^sdp- 
We refer this (1 to be approximation ratio for the maximization model. The larger the 
jj,, the tighter the SDP relaxation. 

First, we ask whether for all values of e e [0, 1), SDP relaxation for the problem 
(|P2p can provide an approximately optimal solution with an objective value that is 
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within a constant factor to the maximum value of (IP2[) . Unfortunately the answer to 
this question is negative. That is, the solution obtained by the SDP relaxation can 
be arbitrarily bad in terms of approximation ratio, for certain value of e. Below we 



show through an example that if e 
Example 3.1: Consider 



0, the ratio between Vqp^ and vJJJ^p can be zero. 



SDP 



max 
s.t. 



|w|| 



where w e 



/3i + /32 = 1 

ft e {0,1}, z = i,2, 

l^. Its SDP relaxation is 



1,2 



(3.2) 



max Tr[X(2)] 



s.t. 



Tr[X(2)]<i + ixW[z,3], * = 1,2 



(3.3) 







" 1 





1 " 






Tr 







1 


1 


X 


= 4 






1 


1 


2 






X ^ 0, 




= 


= 1, 


i = 1,2,3 



For problem (13.21) . w* — [0,0]"^ is its optimal solution, and we have ' 
other hand, it can be easily checked that 

X(i) 



'QP 



0. On the 



with 



x(i) 









X(2) 



X(2) = 



Therefore, for this 
□ 



is a feasible solution for problem (|3.3p . so Wsdp — Tr[X(^)] = 
example the ratio Wqp'^/wgQp is zero. 

In light of the above example, we will focus on the case e G (0, 1) and analyze the 
SDP approximation ratio for problem (|P2p in this case. To this end, we first propose 
a randomization procedure to convert X to a feasible solution of the original problem 
(|P2)) . The detailed steps are listed in Table O 

By the same argument as in Section [2.2[ we can verify that x'^-* generated from 
S1-S2 of Table \3A] satisfies the constraints x-^Bx — 4Q and (x[i])^ — 1 for all i = 
1, • • • , M. To argue that x^^^ is also feasible, it remains to show that x^AjX < 1 + ^ 
for all i € A^. To see this, note that for all i e X, we use the definitions of Ci and 
x^^^ to obtain 



x«A,S= (X(i))^C,X(i) 
= (X(i))^C,x(i) 
< (x(i')^C,S(i) 



- (X(2))^H,x(2) 



1 + 



(1 



i + — . 



(3.4) 
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Table 3.1 

The Randomization Procedure for the Maximization Model 



SO: Obtain the optimal solution X of (|SDP2[) . expressed in the form: 

[ x(2) 

with X(i) € §(_^^+i)x(^^+i) and X(2) € S^-^. 
SI: Let y ^ {X^^) [i,M + l]: ie M}; 

Define an index set X = |« : y[z] > y[Q]i « G A^}- 
82: Set x^^) [M + 1] = 1, X^^) [i] = 1 for aU i e I; 

Set x(i) [i] = -1 for allieM\i. 
S3: Generate a random vector ^ e from the normal 

distribution 7Vf(0,X(^)). 
S4: Let x^^) = where 




(X(1)^,X(2)T)T^ 



Similarly, for all i ^ I, we have x'"'^-'[i] = — 1 and it follows from the definition of Ci 
that (x(i))^C,X(i) = X' and thus 

x^A,X=^ + (x(2))^H,x(2) 

< T + :;i?^^''H.i=l + |. (3.5) 

In summary, the solution x generated from the proposed randomization procedure is 
feasible for problem (|P2[) . 

We are now ready to prove the approximation bounds of the SDP for problem 
(|P2p . with e G (0, 1). First note that in the special case when Q = M, the problem 
(|P2p reduces to the following continuous QCQP 

max ||w||^ 

w 

s.t. w^HiW < 1, ieM. 

For this problem, it has been shown in 'W that the ratio between the optimal value 
of the original problem and its corresponding SDP relaxation is bounded below by 
0(1/ log Af). Thus, we only consider the case Q < A/ — 1 in the following analysis. 

Lemma 3.1. Let Q < M — I and < e < 1. Suppose x is generated by the 
randomization procedure given in Table COl Then with probability 1, x is well defined 
and feasible for (|P2[) . Moreover, for any 7 > and A > 0, 

Prob(p >7, ||x(2)||2 >^rr[X(2)]^ 
>l-a(A,7), (3.6) 
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with 



and 



a{fi,^) = Q ■ r ■ e-^ + {M - Q) ■ f ■ e-^ + , "'^^^ j/F = M, (3.7) 

(1 - m) 



a{fL,^) = Q-f-e-^ + {M-Q)-f-e-- + — — , »/F = C, (3.8) 

e(l - m/7) 

where f := min {rank(H,),rank(X(2))}. 

Proo/. Since X ^ is feasible for (|SDP2p . it follows that Tr[A,;X] < 1 + ^ for 
all i = 1, ■ ■ • , M. On the other hand, the density of ^ H^^ is continuous, thus the 

probability ^ H^^ = is zero, which implies that t computed by Step S4 in Table lOI 
is well defined. This establishes the feasibility of x generated by the randomization 
procedure. 

For any 7 > and /i > 0, we have 

Prob (P > 7, llx'^'lP > /iTr[X(2); 



>Prob(?>7, ll^ll' > ^Tr[X(2)] 



=Prob 



=Prob U^ni < -,Vz e I; i'^H.i <-,VieM\i; U\\^ > ^Tr[X(2)]) . (3.9) 

V 7 7 7 y 

Since Tr[AjX] < 1 + for aU i = 1, • • • , M, we have 
Tr[HiX(2)] = Tr[A,:X] - Tr[C,X(i)] 

= Tr[A,X] - Q + + 2 . 1^ . X(i) [z, Af + 1]) 

e2 /I (l-e)2 l-e\ , , 

where the inequality is due to -1 < X(i'[i,M + 1] < 1. Note that E (H^) = X^^) 
and E (i^Hil) = Tr[HiX(2)]. By combining dHS]) and ([3l0l) . we have 

Prob > 7, ||x(2)||2 > ^Tr[X(2)]) 
>Prob (^i^H.i < ;^Tr[H,X(2)],Vi £ I ; 

i'^H.i < iTr[H,X(2)],Vi e X \ Z; > ^Tr[X(2)]^ 

7 7 / 

>1 - ^ Prob ("i^H,! > -Tr[H,X(2) A _ ^ p^ob ffllii > -TY[ll,5i^^^]\ 
iGi ieA4\i V 7 y 

- Prob (^llif < ^Tr[X(2)]^ . (3.11) 
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When F — C, we have 

Prob (^P > 7, IIX^^^lP > /iTr[X(2); 

> 1 - Q ■ f ■ e'^ - {M - Q) ■ f ■ er^ - Prob {^Uf < ^Tr[X(2)]j (3.12) 

> 1 - Q ■ f ■ e-^ ^ {M ~ Q) ■ f ■ e-^ - . (3.13) 

e(l -m/7) 

where (|3.12p is from the Lenima 5 in [16j , and the last inequahty p.l3p can be verified 
by using Markov inequahty and the property of Weibuh distribution (the details can 
be found in the proof of [16l Theorem 5]). When F = M, the conclusion can be 
similarly proved by utilizing the results stated in [1^1 Page 22]. □ 

Theorem 3.2. When F = R, for real QCQP problem (|P2l) and its SDP relaxation 
(|SDP2p . we have 

max ^ ri(Ai)^^'^ 

with 



2001n(100Q,/2(il/+ 1)) 200 ln(100(M - Q)y/2{M + 1)) 



Proof. By applying a suitable rank reduction procedure if necessary, we can as- 
sume that rank(X(^)) < a/4(M + 1); see 0Ol Section 5]. We apply the randomization 
procedure to X'^^. By using Lemma l3Tl we have, for any 7 > and ft > 0, 



Prob(p>7, ||X(2)||2>^iTr[X(2)] 



^ 1 968 

> 1 - Q^4{M + 1) ■ e"- - (M - Q) V4(M + 1) ■ e"" - ,^ ' . . , . (3.14) 

(1 - A*/7j 



Setting 



7 = min , — , — , u — O.OI7, 

y21n(100g^2(M+ 1)) 21n(100(M- g)^2(M+ 1)) J 

we have that the right hand side of (13.141) is larger than 1 — — — 
0.00222 . . ., which then proves the desired bound. □ 



Theorem 3.3. When F = C, for complex QCQP problem (|P2D and its SDP 
relaxation ()SDP2p . we have 

max ^ ri/f^i,^^^ 

with 



41n(200gv/2(M+ 1))' 41n(200(Af - g)v/2(M+ 1)) 
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Table 4.1 

Mean and standard deviation of the approximation ratio over 300 independent realizations of 
real Gaussian i.i.d. (i = 1, ■ ■ ■ , M), when F = M. 



M 


Q 


iV = 4 


Af = 8 


max mean Std 


max mean Std 


M = 8 


Q = M/4 
Q = M/2 
Q = 3M/4 


3.7394 2.0348 0.2266 
3.9420 1.7972 0.1828 
4.6973 1.7863 0.3921 


4.3387 2.0392 0.2948 
3.5232 1.7378 0.1475 
4.5721 1.8130 0.3428 


M =12 


Q = M/4 
Q = M/2 
Q = 3M/4 


4.9450 2.2191 0.2451 
5.8068 2.0639 0.4564 
7.7829 2.5970 1.3075 


3.9625 2.1710 0.2304 
4.3483 2.0204 0.3241 
9.7150 2.8277 1.9578 


M = 16 


Q = M/4 
Q = M/2 
Q = ZM/A 


4.2703 2.2977 0.2410 
7.3115 2.4463 0.9348 
10.715 3.2272 2.3823 


4.2980 2.2117 0.1972 
7.8240 2.4166 1.1345 
10.621 3.7786 2.8760 



Proof. By applying a suitable rank reduction procedure if necessary, we can as- 
sume that rank(X'^^^) < ^2{M + 1); see 001 Section 5]. We apply the randomization 
procedure to X'^^ By using Lemma |3. 11 we have, for any 7 > and fi > 0, 



Prob (P > 7, p(2)||2 > /iTr[X(2) 
> l-Q^/2{M + l)■e-^ - (Af-Q)V2(M+1) -e^T 



Setting 



e(l - A/7) 



(3.15) 



7 



ln(200Q^2(A/ + 1)) ' ln(200(M - Q)^2(Af + 1)) 



r7: 



we have that the right hand side of (I3.15P is larger than 1 — — ^JS ~ 0.00899 . . ., 
which then proves the desired bound. □ 

Theorem 13.21 and Theorem 13.31 show that for fixed < e < 1 , the approximation 
ratio for the maximization model is the same order of C(l/logM). It is tight for 
general Q, since in a special case, i.e., Q = M, 0{l/\ogM) has been proved to be a 
tight bound [20,. 

We note that for the maximization model, it is possible to use different rounding 
techniques to obtain x^^^ . For example we can decompose the matrix X'^^) using the 
techniques proposed in [20] and [TT]. Nevertheless, these approaches all lead to an 
approximation bound of the same order in terms of M and Q. 

4. Numerical Experiments. While theoretical wrost-case analysis is very use- 
ful, empirical analysis of the ratio Wqp^/wsdp and Wqp'^/wsdp through simulations is 
often equally important. Throughout this section, we generate the data matrix Hi 
by using = hih^ (i = 1, • • • , M), with randomly generated vectors h^. The SDP 
relaxation problems are all solved by CVX ^T0\ . 

For the minimization model, we test the proposed procedure listed in Table [^?T1 for 
different choices of M, Q and N. The Step S3 and Step S4 are repeated by T = 1000 
independent trials, and the solution generated by fcth trial is denoted by (x'^^^)'''. Let 



V- 



UBQP 



min ||(x(2))'=||2. 



Clearly Wub'qp upper bound for Wqp", as a result, Wubqp/^sdp used as 

an upper bound of the true approximation ratio (which is difficult to obtain) . 
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Fig. 4.1. Upper bound on '^Qp /s^gop ^'^ 
Gaussian i.i.d. for i = 1, ■ ■ ■ , M in the real case. 



N = 8, 300 realizations of real 



ratio 




150 
MC trial 



300 



Table 4.2 

Mean and standard deviation of upper bound ratio over 300 independent realizations of real 
Gaussian i.i.d. (i = 1, ■ ■ • , M), when F = C. 



M 


Q 


N = 4 


Af = 8 


max mean Std 


max mean Std 


M = 8 


Q = M/i 
Q = M/2 
Q = 3M/4 


4.8049 2.3720 0.2790 
3.7344 1.9308 0.1443 
2.7549 1.5812 0.0769 


4.3579 2.4239 0.2757 
3.4477 1.9243 0.1477 
2.4477 1.5860 0.0818 


M =12 


Q = M/i 
Q = M/2 
Q = 3M/4 


4.0557 2.4986 0.1938 
3.2911 2.0301 0.1483 
2.6007 1.6451 0.0800 


3.7851 2.4657 0.1998 
3.2867 2.0567 0.1190 
3.1609 1.6693 0.0860 


M =16 


Q = M/4 
Q = M/2 
Q = 3Af/4 


3.8170 2.5778 0.1647 
3.6268 2.0908 0.0932 
2.9218 1.8024 0.1044 


4.2616 2.5852 0.1757 
3.7761 2.0729 0.1065 
3.6056 1.8344 0.1432 



Table |4?T] shows the average ratio (mean) of ^'ubqp/^^sdp O'^^'^ "^00 independent 
reaUzations of i.i.d. real- valued Gaussian hi, (i = I, ■ ■ ■ , M) for several combinations 
of M, Q and N. The maximum value (max) and the standard deviation (Std) of 
^ijBQp/^SDP o'^'^'' 300 independent realizations are also shown in Table WA\ Table 1?^ 
shows the corresponding average value, maximum value and the standard deviation of 
^UBQp/'^^SDP fo'^ F = C. These results are significantly better than what is predicted 
by our worst-case analysis. In all test examples, the average values of ''^ubqp /'i'sDP 
are lower than 4 (resp. lower than 3) when F = K. (resp. when F = C). 

Figure [01 plots i^ubqp/''^sdp ^'^^ ^^O independent realizations of i.i.d. real valued 
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Fig. 4.2. Histogram of the outcomes in Figure \4-. 1\ 
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Gaussian hi (i = 1, • • • , M) for M = 8, Q = 6 and = 8. Figure 1121 shows the 
corresponding histogram. Figure 14.31 and Figure 14.41 show the corresponding results 
for i.i.d complex- valued circular Gaussian h.^ (i — 1, ■ ■ ■ , M). Both the mean and the 
maximum of the upper bound ^^ubqp/i'sdp ^^'^ lower in the complex case. 

Moreover, our numerical results also corroborates well with our theoretic analysis. 
First, the upper bound of the approximation ratio is independent of the dimension 
of w: the results vary only slightly for TV = 4 and TV = 8 in both real and complex 
case. Second, from Table 14.11 it can be shown that for fixed M, the maximum value 
of WuBQp/'^SDP O'^^'' "^^^ independent trials grows as Q increases in all test examples 
except M — 8 and N = 8. It corresponds to the result in Theorem 12.41 While in 
Table IT2I for fixed M, the maximum value of i'ub'qp/ws^p over 300 independent trials 
becomes smaller as Q increases in all test examples, which is also consistent with the 
theoretic result listed in Theorem 12.51 

The above empirical analysis complements our theoretic worst-case analysis of 
the performance of SDP relaxation for the class of mixed integer QCQP problems 
considered herein. 

5. Conclusion and Discussion. Motivated by important emerging applica- 
tions in transmit beamforming for joint physical layer multicasting and admission 
control in wireless networks, this paper proposes new SDP relaxation techniques for 
two classes of nonconvex quadratic optimization problems with mixed binary and 
continuous variables. It is shown that these efficient techniques (polynomial time) are 
guaranteed to provide high quality approximate solutions with a finite approximation 
ratio that is independent of problem dimension and data matrices. This work extends 
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the existing SDP relaxation techniques for continuous nonconvex QCQPs. Our theo- 
retic analysis provides useful insights on the effectiveness of the new SDP relaxation 
techniques for this class of mixed integer QCQP problems. 

It shouUd be pointed out that our worst-case analysis of SDP relaxation perfor- 
mance is based on a certain structure of the discrete variables in the mixed integer 
QCQPs. Can we extend the SDP relaxation techniques and the corresponding analy- 
sis to more general MBQCQP problems? For the maximization model, such extension 
is not possible, as the approximation ratio for SDP relaxation can be zero for certain 
special instances of the problem (see e.g.. Example 3.1). For the minimization model, 
the following counter example suggests that this is also impossible. 

Example 5.1. Consider the following general MBQCQP problem in minimiza- 
tion form: 



min llxlP 



xGR" 

s.t. x^D,x> 1, i = I,-- - ,M (5.1) 

(x[j])2 = i, j = i,... 



with / < n and D^, i = 1, • • • , M being arbitrarily positive semidefinite matrices. The 
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Fig. 4.4. Histogram of the outcomes in Figured 




SDP relaxation for this problem can be expressed as 

niin Tr[X] 

s.t. Tr[D,;X] > 1, i = I,- - • ,M 

^l, j = 1, - ■ ■ ,1 

X ^ 0. 



(5.2) 



We show in the following that SDP relaxation (15.21) can be very loose for this general 
case. Let M = 2, / = 1, n = 2, and let 



Di 



1 



where e is some positive constant. It is relatively easy to show that the optimal 
solution X for problem (|5.1|) is give by 



x[l] = l, x[2] = 



2 1 

.re 



Thus, when e — 0, we have x[2] — > +cx), implying ||x||^ — > +oo. However, it can be 
easily checked that X = I is a feasible solution for the problem ()5.2p . Therefore, the 
optimal solution X for (j5.2|) should satisfy 



Tr[X] < Tr[I] = 2. 
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This example shows that, for a general MBQCQP problem in minimization form, the 
approximation ratio can be arbitrarily large, i.e., the worst-case approximation ratio 
as stated in (|2.3p is /i = +00. 
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